Curriculum Learning for Cumulative Return Maximization

Curriculum learning has been successfully used in reinforcement learning to accelerate the learning process, through knowledge transfer between tasks of increasing complexity. Critical tasks, in which suboptimal exploratory actions must be minimized, can benefit from curriculum learning, and its ability to shape exploration through transfer. We propose a task sequencing algorithm maximizing the cumulative return, that is, the return obtained by the agent across all the learning episodes. By maximizing the cumulative return, the agent not only aims at achieving high rewards as fast as possible, but also at doing so while limiting suboptimal actions. We experimentally compare our task sequencing algorithm to several popular metaheuristic algorithms for combinatorial optimization, and show that it achieves significantly better performance on the problem of cumulative return maximization. Furthermore, we validate our algorithm on a critical task, optimizing a home controller for a micro energy grid

Characterizing web pornography consumption from passive measurements

Web pornography represents a large fraction of the Internet traffic, with thousands of websites and millions of users. Studying web pornography consumption allows understanding human behaviors and it is crucial for medical and psychological research. However, given the lack of public data, these works typically build on surveys, limited by different factors, e.g. unreliable answers that volunteers may (involuntarily) provide. In this work, we collect anonymized accesses to pornography websites using HTTP-level passive traces. Our dataset includes about $15\,000$ broadband subscribers over a period of 3 years. We use it to provide quantitative information about the interactions of users with pornographic websites, focusing on time and frequency of use, habits, and trends. We distribute our anonymized dataset to the community to ease reproducibility and allow further studies.Comment: Passive and Active Measurements Conference 2019 (PAM 2019). 14 pages, 7 figure

An Optimization Framework for Task Sequencing in Curriculum Learning

Curriculum learning in reinforcement learning is used to shape exploration by presenting the agent with increasingly complex tasks. The idea of curriculum learning has been largely applied in both animal training and pedagogy. In reinforcement learning, all previous task sequencing methods have shaped exploration with the objective of reducing the time to reach a given performance level. We propose novel uses of curriculum learning, which arise from choosing different objective functions. Furthermore, we define a general optimization framework for task sequencing and evaluate the performance of popular metaheuristic search methods on several tasks. We show that curriculum learning can be successfully used to: improve the initial performance, take fewer suboptimal actions during exploration, and discover better policies

Characterizing Web Pornography Consumption from Passive Measurements

Web pornography represents a large fraction of the Internet traffic, with thousands of websites and millions of users. Studying web pornography consumption allows understanding human behaviors and it is crucial for medical and psychological research. However, given the lack of public data, these works typically build on surveys, limited by different factors, \eg unreliable answers that volunteers may (involuntarily) provide. In this work, we collect anonymized accesses to pornography websites using HTTP-level passive traces. Our dataset includes about 15,000 broadband subscribers over a period of 3 years. We use it to provide quantitative information about the interactions of users with pornographic websites, focusing on time and frequency of use, habits, and trends. We distribute our anonymized dataset to the community to ease reproducibility and allow further studies

Ceftolozane/tazobactam for the treatment of serious Pseudomonas aeruginosa infections: a multicentre nationwide clinical experience

This study describes the largest clinical experience using ceftolozane/tazobactam (C/T) for different Pseudomonas aeruginosa infections. A retrospective study was performed at 22 hospitals in Italy (June 2016\u2013March 2018). All adult patients treated with 654 days of C/T were enrolled. Successful clinical outcome was defined as complete resolution of clinical signs/symptoms related to P. aeruginosa infection and lack of microbiological evidence of infection. C/T treatment was documented in 101 patients with diverse infections, including nosocomial pneumonia (31.7%), acute bacterial skin and skin-structure infection (20.8%), complicated UTI (13.9%), complicated IAI (12.9%), bone infection (8.9%) and primary bacteraemia (5.9%). Over one-half of P. aeruginosa strains were XDR (50.5%), with 78.2% of isolates resistant to at least one carbapenem. C/T was used as first-line therapy in 39 patients (38.6%). When used as second-line or later, the most common reasons for discontinuation of previous antibiotics were in vitro resistance of P. aeruginosa and clinical failure of previous therapy. Concomitant antibiotics were reported in 35.6% of patients. C/T doses were 1.5 g q8h in 70 patients (69.3%) and 3 g q8h in 31 patients (30.7%); median duration of C/T therapy was 14 days. Overall clinical success was 83.2%. Significant lower success rates were observed in patients with sepsis or receiving continuous renal replacement therapy (CRRT). Mild adverse events were reported in only three patients. C/T demonstrated a favourable safety and tolerability profile regardless of the infection type. Clinicians should be aware of the risk of clinical failure with C/T therapy in septic patients receiving CRRT

Post-thaw viability of in vivo-produced canine blastocysts cryopreserved by slow freezing

The objectives were to evaluate the reexpansion blastocoele rate, post-thaw viability, and in vitro development of canine blastocysts cryopreserved by slow freezing in 1.0 m glycerol (GLY) or 1.5 m ethylene glycol (EG). Fifty-one in vivo-produced canine blastocysts were randomly allocated in two groups: GLY (n = 26) and EG (n = 25). After thawing, embryos from MO were immediately stained with the fluorescent probes propidium iodide and Hoechst 33 342 to evaluate cellular viability. Frozen-thawed embryos from M3 and M6 were cultured in SOFaa medium + 10% FCS at 38.5 degrees C under an atmosphere of 5% CO2 with maximum humidity, for 3 and 6 days, respectively, and similarly stained. The blastocoele reexpansion rate (24 h after in vitro culture) did not differ between GLY (76.5%) and EG (68.8%). Post-thaw viable cells rate were not significantly different between GLY and EG (66.5 +/- 4.8 and 57.3 +/- 4.8, respectively, mean +/- SEM), or among MO (62.3 +/- 5.7%), M3 (56.9 +/- 6.0%), and M6 (66.5 +/- 6.0%). In conclusion, canine blastocysts cryopreserved by slow freezing in 1.0 m glycerol or 1.5 m ethylene glycol, had satisfactory blastocoele reexpansion rates, similar post-thawing viability, and remained viable for up to 6 days of in vitro culture. (C) 2012 Elsevier Inc. All rights reserved.Fundacao de Amparo a Pesquisa do Espirito Santo (FAPES/MCT/CNPq/CTINFRA)CAPES/REUNIDuMilho Raçõe

Estratégias de coping utilizadas por familiares de indivíduos em tratamento hemodialítico

This descriptive, qualitative study aims to identify the coping strategies used most by the family members of patients with chronic kidney disease receiving hemodialysis. The data were collected through interviews, with the Coping Strategies Inventory questionnaire administered to ten family members, and were submitted to descriptive statistics and to thematic content analysis. The strategy used most was escape-avoidance, demonstrating that the family members prefer not to face the situation. The second most-used strategy was social support, ratified by the fact that they stated that they talk with other persons and professionals, seeking information about the problem, and because they accept the support received positively. The third was problem resolution, represented by the attitude of accepting responsibility for the care, either through strong affective bonds or through a feeling of responsibility established prior to the disease. The families use coping strategies of different intensities, while, nevertheless, indicating involvement and major participation in the care for the patient.Estudio cualitativo, que trató de identificar las estrategias de afrontamiento empleadas por las familias de los pacientes con insuficiencia renal crónica en hemodiálisis. Se aplicó el Inventario de Estrategias de Afrontamiento y una questión abierta con diez familiares. Los datos cuantitativos fueron sometidos a procedimientos estatísticos y análisis de contenido cualitativo. La estrategia de mayor utilización fue el escape y evitación (oito), lo que demuestra que los miembros de las familisa preferían no tener que enfrentar esta situación. La siguiente estrategia fue utilizada más apoyo social, ya hablé con otras personas y profesionales que buscan información sobre el problema, y aceptar el apoyo positivo recibido. A terceira foi resolução de problemas, representada pela atitude em assumir o cuidado, seja pelo forte vínculo afetivo ou pelo sentimento de responsabilidade já estabelecido antes da doença. Familias de las estrategias de afrontamiento empleadas con diferentes intensidades, pero mostrando una gran implicación y la participación en el cuidado del paciente crónico.Estudo descritivo, de natureza quali-quantitativa, que objetivou identificar as estratégias de enfrentamento mais utilizadas por familiares de pacientes com doença renal crônica em hemodiálise. Os dados foram coletados por meio de entrevista, com aplicação do Inventário de Estratégias de Coping a dez familiares, e submetidos à estatística descritiva e à análise de conteúdo temática. A estratégia mais utilizada foi fuga e esquiva, demonstrando que os familiares preferiam não enfrentar a situação. A segunda estratégia mais usada foi suporte social, ratificada ao afirmarem que conversaram com outras pessoas e profissionais buscando informações sobre o problema, e por aceitarem positivamente o apoio recebido. A terceira foi resolução de problemas, representada pela atitude em assumir o cuidado, seja pelo forte vínculo afetivo ou pelo sentimento de responsabilidade já estabelecido antes da doença. As famílias empregaram estratégias de enfrentamento com intensidades diferentes, porém indicando envolvimento e grande participação no cuidado ao doente.Universidade Federal de São Paulo (UNIFESP)aff2Universidade Estadual de MaringáUEMUNIFESPSciEL

The role of the mucin-glycan foraging Ruminococcus gnavus in the communication between the gut and the brain

Ruminococcus gnavus is a prevalent member of the human gut microbiota, which is over-represented in inflammatory bowel disease and neurological disorders. We previously showed that the ability of R. gnavus to forage on mucins is strain-dependent and associated with sialic acid metabolism. Here, we showed that mice monocolonized with R. gnavus ATCC 29149 (Rg-mice) display changes in major sialic acid derivatives in their cecum content, blood, and brain, which is accompanied by a significant decrease in the percentage of sialylated residues in intestinal mucins relative to germ-free (GF) mice. Changes in metabolites associated with brain function such as tryptamine, indolacetate, and trimethylamine N-oxide were also detected in the cecal content of Rg-mice when compared to GF mice. Next, we investigated the effect of R. gnavus monocolonization on hippocampus cell proliferation and behavior. We observed a significant decrease of PSA-NCAM immunoreactive granule cells in the dentate gyrus (DG) of Rg-mice as compared to GF mice and recruitment of phagocytic microglia in the vicinity. Behavioral assessments suggested an improvement of the spatial working memory in Rg-mice but no change in other cognitive functions. These results were also supported by a significant upregulation of genes involved in proliferation and neuroplasticity. Collectively, these data provide first insights into how R. gnavus metabolites may influence brain regulation and function through modulation of granule cell development and synaptic plasticity in the adult hippocampus. This work has implications for further understanding the mechanisms underpinning the role of R. gnavus in neurological disorders